Safe Local Navigation for Visually Impaired Users With a Time-of-Flight and Haptic Feedback Device

This paper presents ALVU (Array of Lidars and Vibrotactile Units), a contactless, intuitive, hands-free, and discreet wearable device that allows visually impaired users to detect low- and high-hanging obstacles, as well as physical boundaries in their immediate environment. The solution allows for safe local navigation in both confined and open spaces by enabling the user to distinguish free space from obstacles. The device presented is composed of two parts: a sensor belt and a haptic strap. The sensor belt is an array of time-of-flight distance sensors worn around the front of a user's waist, and the pulses of infrared light provide reliable and accurate measurements of the distances between the user and surrounding obstacles or surfaces. The haptic strap communicates the measured distances through an array of vibratory motors worn around the user's upper abdomen, providing haptic feedback. The linear vibration motors are combined with a point-loaded pretensioned applicator to transmit isolated vibrations to the user. We validated the device's capability in an extensive user study entailing 162 trials with 12 blind users. Users wearing the device successfully walked through hallways, avoided obstacles, and detected staircases.Andrea Bocelli FoundationNational Science Foundation (U.S.) (Grant NSF IIS1226883

A Compact Acoustic Communication Module for Remote Control Underwater

This paper describes an end-to-end compact acoustic communication system designed for easy integration into remotely controlled underwater operations. The system supports up to 2048 commands that are encoded as 16 bit words. We present the design, hardware, and supporting algorithms for this system. A pulse-based FSK modulation scheme is presented, along with a method of demodulation requiring minimal processing power that leverages the Goertzel algorithm and dynamic peak detection. We packaged the system together with an intuitive user interface for remotely controlling an autonomous underwater vehicle. We evaluated this system in the pool and in the open ocean. We present the communication data collected during experiments using the system to control an underwater robot.National Science Foundation (U.S.) (NSF 1117178)National Science Foundation (U.S.) (NSF IIS1226883)National Science Foundation (U.S.) (Award 112237

Building and controlling fluidically actuated soft robots : from open loop to model-based control

Thesis: Ph. D., Massachusetts Institute of Technology, Department of Mechanical Engineering, 2018.This electronic version was submitted by the student author. The certified thesis is available in the Institute Archives and Special Collections.Cataloged from student-submitted PDF version of thesis.Includes bibliographical references (pages 247-272).This thesis describes the creation and control of soft robots made of deformable elastomer materials and powered by fluidics. We embed soft fluidic actuators into self-contained soft robotic systems, such as fish for underwater exploration or soft arms for dynamic manipulation. We present models describing the physical characteristics of these continuously deformable and fully soft robots, and then leverage these models for motion planning and closed-loop feedback control in order to realize quasi-static manipulation, dynamic arm motions, and dynamic interactions with an environment. The design and fabrication techniques for our soft robots include the development of soft actuator morphologies, soft casting techniques, and closed-circuit pneumatic and hydraulic powering methods. With a modular design approach, we combine these soft actuator morphologies into robotic systems. We create a robotic fish for underwater locomotion, as well as multi-finger hands and multi-segment arms for use in object manipulation and interaction with an environment. The robotic fish uses a soft hydraulic actuator as its deformable tail to perform open-loop controlled swimming motions through cyclic undulation. The swimming movement is achieved by a custom-made displacement pump and a custom-made buoyancy control unit, all embedded within the soft robotic fish. The fish robot receives high-level control commands via acoustic signals to move in marine environments. The control of the multi-segment arms is enabled by models describing the geometry, kinematics, impedance, and dynamics. We use the models for quasi-static closed-loop control and dynamic closed-loop control. The quasi-static controllers work in combination with the kinematic models and geometric motion planners to enable the soft arms to move in confined spaces, and to autonomously perform object grasping. Leveraging the models for impedance and dynamics, we also demonstrate dynamic arm motions and end-effector interactions of the arm with an environment. Our dynamic model allows the application of control techniques developed for rigid robots to the dynamic control of soft robots. The resulting model-based closed-loop controllers enable dynamic curvature tracking as well as surface tracing in Cartesian space.by Robert Kevin Katzschmann.Ph. D

A soft cube capable of controllable continuous jumping

Soft-bodied robots are designed to work in the physical world with a high compliance, while most of them lack in highly dynamic motion. In this paper, we present a soft-bodied jumping robot, which leverages its body's elasticity to achieve a highly dynamic passive bouncing motion after an active jumping motion. This robot has a cubic shape. It is covered by silicone foam, and each of its six faces has an opening to allow for jumping actuation. By winding up and releasing an elastic strip, the robot can jump in two directions at any orientation. We present the design, and fabrication process, and experimental results. By comparing this robot with a rigid version of the robot, we show that this soft-bodied robot can use a single jump to travel longer forward than its rigid counterpart

Safe Local Navigation for Visually Impaired Users with a Time-of-Flight and Haptic Feedback Device

This paper presents ALVU (Array of Lidars and Vibrotactile Units), a contactless, intuitive, hands-free, and discreet wearable device that allows visually impaired users to detect low- and high-hanging obstacles, as well as physical boundaries in their immediate environment. The solution allows for safe local navigation in both confined and open spaces by enabling the user to distinguish free space from obstacles. The device presented is composed of two parts: a sensor belt and a haptic strap. The sensor belt is an array of time-of-flight distance sensors worn around the front of a user’s waist, and the pulses of infrared light provide reliable and accurate measurements of the distances between the user and surrounding obstacles or surfaces. The haptic strap communicates the measured distances through an array of vibratory motors worn around the user’s upper abdomen, providing haptic feedback. The linear vibration motors are combined with a point-loaded pretensioned applicator to transmit isolated vibrations to the user. We validated the device’s capability in an extensive user study entailing 162 trials with 12 blind users. Users wearing the device successfully walked through hallways, avoided obstacles, and detected staircases. Keywords: haptic interfaces; navigation; robot sensing systems; vibrations; belts; sensor arrays; cameras; assistive device; sightless navigation; human-robot interaction; perception; haptic feedback arrayNational Science Foundation (U.S.) (Grant IIS1226883

Printable Hydraulics: A Method for Fabricating Robots by 3D Co-Printing Solids and Liquids

This paper introduces a novel technique for fabricating functional robots using 3D printers. Simultaneously depositing photopolymers and a non-curing liquid allows complex, pre-filled fluidic channels to be fabricated. This new printing capability enables complex hydraulically actuated robots and robotic components to be automatically built, with no assembly required. The technique is showcased by printing linear bellows actuators, gear pumps, soft grippers and a hexapod robot, using a commercially-available 3D printer. We detail the steps required to modify the printer and describe the design constraints imposed by this new fabrication approach.National Science Foundation (U.S.) (Grant IIS-1226883)National Science Foundation (U.S.) (Grant CCF-1138967

Exploration of underwater life with an acoustically controlled soft robotic fish

Closeup exploration of underwater life requires new forms of interaction, using biomimetic creatures that are capable of agile swimming maneuvers, equipped with cameras, and supported by remote human operation. Current robotic prototypes do not provide adequate platforms for studying marine life in their natural habitats. This work presents the design, fabrication, control, and oceanic testing of a soft robotic fish that can swim in three dimensions to continuously record the aquatic life it is following or engaging. Using a miniaturized acoustic communication module, a diver can direct the fish by sending commands such as speed, turning angle, and dynamic vertical diving. This work builds on previous generations of robotic fish that were restricted to one plane in shallow water and lacked remote control. Experimental results gathered from tests along coral reefs in the Pacific Ocean show that the robotic fish can successfully navigate around aquatic life at depths ranging from 0 to 18 meters. Furthermore, our robotic fish exhibits a lifelike undulating tail motion enabled by a soft robotic actuator design that can potentially facilitate a more natural integration into the ocean environment. We believe that our study advances beyond what is currently achievable using traditional thruster-based and tethered autonomous underwater vehicles, demonstrating methods that can be used in the future for studying the interactions of aquatic life and ocean dynamics.National Science Foundation (U.S.) (Grant NSF 1117178)National Science Foundation (U.S.) (Grant NSF IIS1226883)National Science Foundation (U.S.) (Grant CCF1138967)National Science Foundation (U.S.) (Award 1122374

Hydraulic Autonomous Soft Robotic Fish for 3D Swimming

© Springer International Publishing Switzerland 2016. Thiswork presents an autonomous soft-bodied robotic fish that is hydraulically actuated and capable of sustained swimming in three dimensions. The design of a fish-like soft body has been extended to deform under hydraulic instead of pneumatic power. Moreover, a new closed-circuit drive system that uses water as a transmission fluid is used to actuate the soft body. Circulation of water through internal body channels provides control over the fish’s caudal fin propulsion and yaw motion. A new fabrication technique for the soft body is described, which allows for arbitrary internal fluidic channels, enabling a wide-range of continuous body deformations. Furthermore, dynamic diving capabilities are introduced through pectoral fins as dive planes. These innovations enable prolonged fish-like locomotion in three dimensions.NSF (Grants 1117178, 1133224, IIS1226883 and CCF1138967)NSF (Award 1122374

Whole arm planning for a soft and highly compliant 2D robotic manipulator

Soft continuum manipulators have the advantage of being more compliant and having more degrees of freedom than rigid redundant manipulators. This attribute should allow soft manipulators to autonomously execute highly dexterous tasks. However, current approaches to motion planning, inverse kinematics, and even design limit the capacity of soft manipulators to take full advantage of their inherent compliance. We provide a computational approach to whole arm planning for a soft planar manipulator that advances the arm's end effector pose in task space while simultaneously considering the arm's entire envelope in proximity to a confined environment. The algorithm solves a series of constrained optimization problems to determine locally optimal inverse kinematics. Due to inherent limitations in modeling the kinematics of a highly compliant soft robot and the local optimality of the planner's solutions, we also rely on the increased softness of our newly designed manipulator to accomplish the whole arm task, namely the arm's ability to harmlessly collide with the environment. We detail the design and fabrication of the new modular manipulator as well as the planner's central algorithm. We experimentally validate our approach by showing that the robotic system is capable of autonomously advancing the soft arm through a pipe-like environment in order to reach distinct goal states.National Science Foundation (U.S.) (grant number NSF IIS1226883)National Science Foundation (U.S.) (grant number NSF CCF1138967)National Science Foundation (U.S.). Graduate Research Fellowship Program (primary award number 1122374

Dynamic Control of Soft Robots Interacting with the Environment

Despite the emergence of many soft-bodied robotic systems, model-based feedback control has remained an open challenge. This is largely due to the intrinsic difficulties in designing controllers for systems with infinite dimensions. In this paper we propose an alternative formulation of the soft robot dynamics which connects the robot’s behavior with the one of a rigid bodied robot with elasticity in the joints. The matching between the two system is exact under the common hypothesis of Piecewise Constant Curvature. Based on this connection we introduce two control architectures, with the aim of achieving accurate curvature control and Cartesian regulation of the robot’s impedance, respectively. The curvature controller accounts for the natural softness of the system, while the Cartesian controller adapts the impedance of the end effector for interactions with an unstructured environment. This work proposes the first closed loop dynamic controller for a continuous soft robot. The controllers are validated and evaluated on a physical soft robot capable of planar manipulation.National Science Foundation (U.S.) (Grant NSF 1117178)National Science Foundation (U.S.) (Grant NSF IIS1226883)National Science Foundation (U.S.) (Grant NSF CCF1138967)Horizon 2020 Framework Programme (European Commission) (Grant 645599